Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA.

With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher's question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.

Red Media vs. Blue Media: Social Distancing and Partisan News Media Use during the COVID-19 Pandemic.

Political polarization surrounding the COVID-19 health crisis has been on the rise since the beginning of the pandemic. We combine prior research on motivated reasoning, selective exposure, and news framing to understand the association between partisan media use and social distancing behavior related to COVID-19. To do so, we collected media content data and national survey data during the onset of the pandemic. We employed structural topic modeling (STM), dependency parsing, word co-occurrence, and manual coding to examine the media coverage. Next, we analyzed survey data collected with a Qualtrics panel from a sample of U.S. residents for factors explaining social distancing behaviors. Results reveal coverage from the right leaning outlets downplayed the virus and highlighted the consequences of lockdowns on the economy. Our survey findings show that even after accounting for a range of demographic, political orientation, and COVID-19 awareness variables, conservative media use was linked, although modestly, with a lower likelihood of social distancing behavior. Our findings echo past research on media framing of pandemics and their association with public attitudes and behavior.

The Relationship among COVID-19 Information Seeking, News Media Use, and Emotional Distress at the Onset of the Pandemic.

Although several theories posit that information seeking is related to better psychological health, this logic may not apply to a pandemic like COVID-19. Given uncertainty inherent to the novel virus, we expect that information seeking about COVID-19 will be positively associated with emotional distress. Additionally, we consider the type of news media from which individuals receive information-television, newspapers, and social media-when examining relationships with emotional distress. Using a U.S. national survey, we examine: (1) the link between information seeking about COVID-19 and emotional distress, (2) the relationship between reliance on television, newspapers, and social media as sources for news and emotional distress, and (3) the interaction between information seeking and use of these news media sources on emotional distress. Our findings show that seeking information about COVID-19 was significantly related to emotional distress. Moreover, even after accounting for COVID-19 information seeking, consuming news via television and social media was tied to increased distress, whereas consuming newspapers was not significantly related to greater distress. Emotional distress was most pronounced among individuals high in information seeking and television news use, whereas the association between information seeking and emotional distress was not moderated by newspapers or social media news use.

A Mixed Methods Study of Public Perception of Social Distancing: Integrating Qualitative and Computational Analyses for Text Data

In a rapidly changing public health crisis such as COVID-19, researchers need innovative approaches that can effectively link qualitative approaches and computational methods. In this article, computational and qualitative methods are used to analyze survey data collected in March 2020 (n = 2,270) to explore the content of persuasive messages and their relationship with self-reported health behavior?that is, social distancing. Results suggest that persuasive messages, based on participants? perspectives, vary by gender and race and are associated with self-reported health behavior. This article illustrates how qualitative analysis and structural topic modeling can be used in synergy in a public health study to understand the public?s perception and behavior related to science issues. Implications for health communication and future research are discussed.

News Attention and Social-Distancing Behavior Amid COVID-19: How Media Trust and Social Norms Moderate a Mediated Relationship.

Despite the fact that social distancing is an effective mean to slow the spread of COVID-19, individuals often fail to practice this behavior. Major US news media provided information to the public about social distancing after COVID-19 was declared a pandemic, potentially spurring this preventative health practice. Using data from a representative sample of US residents, this study aims to understand the relationship between news media attention and social-distancing behavior via three potential mediators: perceived effectiveness of social distancing, perceived susceptibility to COVID-19 infection, and perceived negative consequences of infection. Media trust and social norms concerning social distancing were included as potential moderators of these relationships, along with political ideology. With multiple regression and mediation analyses, we found that news media attention was positively associated with social-distancing behavior during this period. Perceived effectiveness of social distancing mediated this relationship, while perceived susceptibility and negative consequences of COVID-19 did not. Notably, media trust negatively moderated news attention's impact on the perceived effectiveness of social distancing, with the relationship being more pronounced among those who have lower trust in media. Political ideology did not moderate the relationship between news attention and perceived effectiveness. Further, social norms negatively moderated the relationship between perceived effectiveness and social-distancing behavior, with this relationship growing stronger among those uncertain about the adoption of social-distancing norms in their circle. Overall, the study found news media to have an important role in promoting social-distancing behavior when they emphasized safety measures across the ideological spectrum.

How public perceptions of social distancing evolved over a critical time period: communication lessons learnt from the American state of Wisconsin

Understanding how individuals perceive the barriers and benefits of precautionary actions is key for effective communication about public health crises, such as the COVID-19 outbreak. This study used innovative computational methods to analyze 30,000 open-ended responses from a large-scale survey to track how Wisconsin (U.S.A.) residents' perceptions of the benefits of and barriers to performing social distancing evolved over a critical time period (March 19th to April 1st, 2020). Initially, the main barrier was practical related, however, individuals later perceived more multifaceted barriers to social distancing. Communication about COVID-19 should be dynamic and evolve to address people's experiences and needs overtime.